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Abstract — The statistical mechanical interpretation of algorith- 
mic information theory (AIT, for short) was introduced and 
developed by our former works [K. Tadaki, Local Proceedings 
of CiE 2008, pp. 425^34, 2008] and [K. Tadaki, Proceedings of 
LFCS'09, Springer's LNCS, vol. 5407, pp. 422-440, 2009], where 
we introduced the notion of thermodynamic quantities, such 
as partition function Z{T), free energy F{T), energy E{T), 
and statistical mechanical entropy S{T), into AIT. We then 
discovered that, in the interpretation, the temperature T equals to 
the partial randomness of the values of all these thermodynamic 
quantities, where the notion of partial randomness is a stronger 
representation of the compression rate by means of program-size 
complexity. Furthermore, we showed that this situation holds for 
the temperature itself as a thermodynamic quantity, namely, for 
each of all the thermodynamic quantities above, the computabil- 
ity of its value at temperature T gives a sufficient condition 
for T G (0, 1) to be a fixed point on partial randomness. In 
this paper, we develop the statistical mechanical interpretation 
of AIT further and pursue its formal correspondence to normal 
statistical mechanics. The thermodynamic quantities in AIT are 
defined based on the halting set of an optimal computer, which 
is a universal decoding algorithm used to define the notion of 
program-size complexity. We show that there are infinitely many 
optimal computers which give completely different sufficient 
conditions in each of the thermodynamic quantities in AIT. We do 
this by introducing the notion of composition of computers into 
AIT, which corresponds to the notion of composition of systems 
in normal statistical mechanics. 

I. Introduction 

Algorithmic information theory (AIT, for short) is a frame- 
work for applying information-theoretic and probabilistic ideas 
to recursive function theory. One of the primary concepts 
of AIT is the program-size complexity (or Kolmogorov com- 
plexity) H{s) of a finite binary string s, which is defined 
as the length of the shortest binary program for an optimal 
computer to output s. Here an optimal computer is a universal 
decoding algorithm. By the definition, H{s) is thought to 
represent the amount of randomness contained in a finite 
binary string s, which cannot be captured in a computational 
manner In particular, the notion of program-size complexity 
plays a crucial role in characterizing the randomness of an 
infinite binary string, or equivalently, a real. 

In lfT2l we introduced and developed a statistical mechanical 



interpretation of AIT. We there introduced the notion of 
thermodynamic quantities at temperature T, such as partition 
function Z{T), free energy F{T), energy E{T), and statistical 
mechanical entropy S{T), into AIT. These quantities are real 
functions of a real argument T > 0. We then proved that 
if the temperature T is a computable real with < T < 1 
then, for each of these thermodynamic quantities, the partial 
randomness of its value equals to T, where the notion of 
partial randomness is a stronger representation of the com- 
pression rate by means of program-size complexity. Thus, 
the temperature T plays a role as the partial randomness of 
all the thermodynamic quantities in the statistical mechanical 
interpretation of AIT. In fT2l we further showed that the 
temperature T plays a role as the partial randomness of the 
temperature T itself, which is a thermodynamic quantity of 
itself. Namely, we proved the fixed point theorem on partial 
randomnessli which states that, for every T G (0, 1), if 
the value of partition function Z{T) at temperature T is a 
computable real, then the partial randomness of T equals to 
T, and therefore the compression rate of T equals to T, i.e., 
lim„^oo H{T\n)/n = T, where Tf,, is the first n bits of the 
base-two expansion of T. 

In our second work [13 1 on this interpretation, we showed 
that a fixed point theorem of the same form as for Z{T) holds 
also for each of free energy F{T), energy E{T), and statistical 
mechanical entropy S{T). Moreover, based on the statistical 
mechanical relation F{T) = — Tlog2 Z{T), we showed that 
the computability of F{T) gives completely different fixed 
points from the computability of Z{T). 

In this paper, we develop the statistical mechanical inter- 
pretation of AIT further and pursue its formal correspondence 
to normal statistical mechanics. As a result, we unlock the 
properties of the sufficient conditions further. The thermody- 
namic quantities in AIT are defined based on the halting set 
of an optimal computer In this paper, we show in Theorem |9] 
below that there are infinitely many optimal computers which 
give completely different sufficient conditions in each of the 

' The fixed point theorem on partial randomness is called a fixed point 
theorem on compression rate in 1121 . 



thermodynamic quantities in AIT. We do this by introducing 
the notion of composition of computers into AIT, which 
corresponds to the notion of composition of systems in normal 
statistical mechanics. 

II. Preliminaries 

A. Basic notation 

We start with some notation about numbers and strings 
which will be used in this paper. N = {0, 1, 2, 3, ... } is the set 
of natural numbers, and is the set of positive integers. Q 
is the set of rationals, and M is the set of reals. Let f : S ^M. 
with 5 C M. We say that / is increasing (resp., decreasing) 
if f{x) < f{y) (resp., f{x) > f{y)) for all x,y e S with 
X <y. 

Normally, o(n) denotes any function / : M such that 

lim„^oo f{n)/n = 0. 

{0,1}* {A,0, 1,00,01,10, 11,000, ...} is the set of 
finite binary strings, where A denotes the empty string. For 
any s € {0, 1}*, \s\ is the length of s. A subset S of {0, 1}* 
is called prefix-free if no string in is a prefix of another string 
in S. For any partial function /, the domain of definition of 
/ is denoted by dom /. 

Let a be an arbitrary real. We denote by a|"„G {0, 1}* the 
first n bits of the base-two expansion of a — \ a\ with infinitely 
many zeros, where [aj is the greatest integer less than or equal 
to a. For example, in the case of a = 5/8, a\Q= 101000. 

We say that a real a is computable if there exists a total 
recursive function /: N''" Q such that \a — f{n)\ < 1/n 
for all n e N+. See e.g. Weihrauch HSI for the detail of the 
treatment of the computability of reals. 

B. Algorithmic information theory 

In the following we concisely review some definitions and 
results of algorithmic information theory ||4], 131, JSl, Q. A 
computer is a partial recursive function C : {0, 1}* — > {0, 1}* 
such that domC is a nonempty prefix-free set. For each 
computer C and each s G {0,1}*, Hc{s) is defined by 
Hc[s) = min {\p\ \ p€ {0, 1}* & C{p) = s ] (may be oo). 
A computer U is said to be optimal if for each computer C 
there exists d e N, which depends on C, with the following 
property; for every p e domC there exists q E {0, 1}* for 
which U{q) = C{p) and \q\ < |p| + d. It is easy to see 
that there exists an optimal computer We choose a particular 
optimal computer U as the standard one for use, and define 
H{s) as Hu{s), which is referred to as the program-size 
complexity of s or the Kolmogorov complexity of s. It follows 
that for every computer C there exists d E N such that, for 
every s E {0, 1}*, H{s) < Hc{s) + d. 

For any a G R, we say that a is weakly Chaitin random if 
there exists c e N such that n — c < H{a\n) for all n E 
HI, 10. On the other hand, for any a e M, we say that a 
is Chaitin random if lim„_>oo ^^(ck \n) ~ n — oo Q. 
Obviously, for every a G M, if a is Chaitin random, then a is 
weakly Chaitin random. We can show that the converse also 
hold. Thus, for every a G M, a is weakly Chaitin random if 
and only if a is Chaitin random (see Chaitin 15j for the proof 
and historical detail). 



C. Partial randomness 

In the works lITOl , ifTTl , we generalized the notion of the 
randomness of a real so that the degree of the randomness, 
which is often referred to as the partial randomness recently 
El, m. El, can be characterized by a real T with < T < 1 
as follows. 

Definition 1 (weak Chaitin T-randomness). Let T G M with 
T > 0. For any a G R, we say that a is weakly Chaitin T- 
random if there exists c G N such that Tn — c < H{a\n) for 
all n E N+. ■ 

Definition 2 (T-compressibility). LetT eR with T > 0. For 
any a eR, we say that a is T -compressible if H{a\n) < Tn+ 
o{n), which is equivalent to limsup^^^^^ H{a\n)/n < T. ■ 

In the case of T = 1, the weak Chaitin T-randomness 
results in the weak Chaitin randomness. For every T E [0, 1] 
and every a G M, if a is weakly Chaitin T-random and T- 
compressible, then 

Hia\r 



lim 

n—^OG 



T. 



(1) 



The left-hand side of ([T]) is referred to as the compression 
rate of a real a in general. Note, however, that ([T]) does not 
necessarily imply that a is weakly Chaitin T-random. Thus, 
the notion of partial randomness is a stronger representation 
of the notion of compression rate. 

Definition 3 (Chaitin T-randomness, Tadaki IlOl, |[TT1)- Let 

T G M with T > 0. For any a G K, we say that a is Chaitin 
T-random if \m\n^oo H{a\n) — Tn ~ oo. ■ 

In the case of T = 1, the Chaitin T-randomness results in 
the Chaitin randomness. Obviously, for every T G [0, 1] and 
every a G M, if a is Chaitin T-random, then a is weakly 
Chaitin T-random. However, in 2005 Reimann and Stephan 
[9| showed that, in the case of T < 1, the converse does not 
necessarily hold. This contrasts with the equivalence between 
the weak Chaitin randomness and the Chaitin randomness, 
each of which corresponds to the case of T = 1. 

III. The previous results 

In this section, we review some results of the statistical me- 
chanical interpretation of AIT, developed by our former works 
lfT2l , US]. We first introduce the notion of thermodynamic 
quantities into AIT in the following manner. 

In statistical mechanics, the partition function Zsm{T), 
free energy Fs,n(T), energy Ss,n(T), and entropy Ssm{T) at 
temperature T are given as follows: 



ZsmiT) 



Fsn.iT) = -A:BTlnZ,„,(T), 



(2) 



xex 



where X is a complete set of energy eigenstates of a quantum 
system and is the energy of an energy eigenstate x. The 
constant fee is called the Boltzmann Constant, and the In 
denotes the natural logarithm]! 

Let C be an arbitrary computer. We introduce the notion 
of thermodynamic quantities into AIT by performing Re- 
placements [T] below for the thermodynamic quantities (|2]i in 
statistical mechanics. 

Replacements 1. 

(i) Replace the complete set X of energy eigenstates x by 
the set dom C of all programs p for C. 

(ii) Replace the energy of an energy eigenstate x by the 
length \p\ of a program p. 

(iii) Set the Boltzmann Constant to 1/ In 2. ■ 

Thus, motivated by the formulae and taking into account 
Replacements [T] we introduce the notion of thermodynamic 
quantities into AIT as follows. 

Definition 4 (thermodynamic quantities in AIT, 1 12il). Let C 

be any computer, and let T be any real with T > 0. 

First consider the case where dom C is an infinite set. In this 
case, we choose a particular enumeration pi,p2,P3,Pi, ■ ■ ■ of 
the countably infinite set dom (70 

(i) The partition function Zc{T) at temperature T is de- 
fined as limfe^oo Zk{T) where 

k 

Zk{T) ^Y."^-^ . (3) 

1=1 

(ii) The free energy Fq {T) at temperature T is defined as 

linifc^oo -Ffe(r) where 

Fk{T) = -T\og2Zk{T). (4) 

(iii) The energy Ec(T) at temperature T is defined as 
linifc^oo -E^fc(r) where 

Sfem-^^^El^^'l^^^- (5) 

' i=l 

(iv) The statistical mechanical entropy Sc(T) at tempera- 
ture T is defined as lim^-^oo Sk{T) where 

Su{T) = ^'^(^^-^'^(^1 (6) 

In the case where dom C is a nonempty finite set, the 
quantities Zc(T), Fc{T), Ec{T), and Sc{T) are just defined 
as (O, (|5]), and respectively, where pi, . . . ,pk is an 
enumeration of the finite set dom C. ■ 

Note that, for every optimal computer V, Zv{l) is precisely 
a Chaitin number introduced by Chaitin (4]. Theorems |5] and 
|6] below hold for these thermodynamic quantities in AIT. 

^ For the thermodynamic quantities in statistical mechanics, see e.g. Chapter 
16 of 1 11 and Chapter 2 of 1 14|. To be precise, the partition function is not a 
thermodynamic quantity but a statistical mechanical quantity. 

^ The enumeration {pi} can be chosen quite arbitrarily, and the results of 
this paper are independent of the choice of {pi}. This is because the sum 
2~IPil/^ and \Pi\ 2~IPil/^ in Definition |4] are positive term 

series and converge as fc ^ oo for every T G (0, 1). 



Theorem 5 (properties of Z{T) and F{T), |[Tol, O], CI). 

Let V be an optimal computer, and let T G R. 

(i) 7/0 < T < 1 and T is computable, then each of Zv(T) 
and Fv (T) converges and is weakly Chaitin T-random 
and T-compressible. 

(ii) If \ < T, then Zv{T) and Fv{T) diverge to oo and 
—oo, respectively. ■ 

Theorem 6 (properties of E{T) and S{T), Qil). Let V be 
an optimal computer, and let T G M. 

(i) IfO<T<l and T is computable, then each of Ev{T) 
and S'y(r) converges and is Chaitin T-random and T- 
compressible. 

(ii) Ifl<T, then both Ey (T) and Sy (T) diverge to oo. ■ 

The above two theorems show that if T is a computable 
real with T G (0, 1) then the temperature T equals to the 
partial randomness (and therefore the compression rate) of the 
values of all the thermodynamic quantities in Definition |4] for 
an optimal computer. 

These theorems also show that the values of all the thermo- 
dynamic quantities diverge when the temperature T exceeds 
1. This phenomenon might be regarded as some sort of phase 
transition in statistical mechanics. Note here that the weak 
Chaitin T-randomness in Theorem|5]is replaced by the Chaitin 
T-randomness in Theorem |6] in exchange for the divergence 
at T = 1. 

In statistical mechanics or thermodynamics, among all ther- 
modynamic quantities one of the most typical thermodynamic 
quantities is temperature itself. Theorem |7] below shows that 
the partial randomness of the temperature T can equal to the 
temperature T itself in the statistical mechanical interpretation 
of AIT. 

We denote by TV-u, the set of all real T G (0, 1) such that T 
is weakly Chaitin T-random and T-compressible, and denote 
by TP the set of all real T G (0,1) such that T is Chaitin 
T-random and T-compressible. Obviously, TV C TVw Each 
element T of J-Vw is a. fixed point on partial randomness, i.e., 
satisfies the property that the partial randomness of T equals to 
T itself, and therefore satisfies that lim„^oo H{T\n)/n = T. 
Let y be a computer. We define the sets Z{V) by 

Z{V) = {T G (0, 1) I Zv{T) is computable}. 

In the same manner, we define the sets T{V), S{V), and S{V) 
based on the computabiHty of Fv{T), Ev{T), and Sv{T), 
respectively. We can then show the following. 

Theorem 7 (fixed points on partial randomness, lfT2l . ifTsll ). 

Let V be an optimal computer. Then Z(V) U J'{V) C TVw 
and £{V) U slv) C TV. ■ 

Theorem |7] is just a fixed point theorem on partial random- 
ness, where the computability of each of the values Zy(T), 
Ty(T), Ev{T), and S'y(T) gives a sufficient condition for a 
real T G (0, 1) to be a fixed point on partial randomness. Thus, 
by Theorem |2l the above observation that the temperature T 
equals to the partial randomness of the values of the thermo- 



dynamic quantities in the statistical mechanical interpretation 
of AIT is further confirmed. 

IV. The main result 

In this paper, we investigate the properties of the sufficient 
conditions for T to be a fixed point on partial randomness 
in Theorem |2l Using the monotonicity and continuity of the 
functions Zv{T) and Fv{T) on temperature T and using 
the statistical mechanical relation Fy{T) — ~T\og2 Zv{T), 
which holds from Definition H] we can show the following 
theorem for the sufficient conditions in Theorem |2l 

Theorem 8 (|13|). Let V be an optimal computer. Then each 
of the sets ZiV) and J-{V) is dense in (0, 1) while Z{V) n 
T{V) = 0. ■ 

Thus, for every optimal computer V, the computability 
of Fv{T) gives completely different fixed points from the 
computability of Zv{T). This implies also that Z{V) ^ TViu 
and F{V) C TV^,- 

The aim of this paper is to investigate the structure of TViu 
and TV in greater detail. Namely, we show in Theorem |9] 
below that there are infinitely many optimal computers which 
give completely different sufficient conditions in each of the 
thermodynamic quantities in AIT. We say that an infinite se- 
quence Vi,V2,V3, . . . of computers is recursive if there exists 
a partial recursive function F: N+ x {0,1}* {0,1}* such 
that for each n e the following two hold: (i) p G dom Vn 
if and only if {n,p) G domF, and (ii) Vn{p) = F{n,p) for 
every p £ dom Vn- Then the main result of this paper is given 
as follows. 

Theorem 9 (main result). There exists a recursive infinite 
sequence Vi, V2, V3, . . . of optimal computers which satisfies 
the following conditions: 

(i) ziy,) n z{v,) = nv,) n HVj) = s{v,) n E{v,) = 

S{V,) n S{Vj) = for all i,j with i ^ j. 

(ii) U. ZiV^) C TV^ and U, HV^) C TV^. 

(iii) £(yi) C TV and U, S{V) C TV. ■ 

In the subsequent sections we prove the above theorems by 
introducing the notion of composition of computers into AIT, 
which corresponds to the notion of composition of systems in 
normal statistical mechanics. 

V. Composition of computers 

Definition 10 (composition of computers). 

Let Ci, C2, . . . , Cn be computers. The composition Ci 06*2 
• ■ ■ Cn of Ci, C2, • • . , and Cn is defined as the computer 
D such that (i) dom 13 = {piP2 • ■ -Pn \ Pi £ domCi & p2 G 
domC2 & • • • & Pn G domCAr}, and (ii) D{pip2 ■ ■ -Pn) — 
Ci{pi) for every pi G domCi, p2 £ domC2, . . ., and pN G 
dom Cat. ■ 

Theorem 11. Let Ci, C2, . . . , Cat be computers. If Ci is 
optimal then Ci C2 ■ • ■ Cat is also optimal. 

Proof: We first choose particular strings r2, ra, . . . , rjv 
with r2 G domC2, r-^ G domCa, and G domCAf. 



Let C be an arbitrary computer Then, by the definition of 
the optimality of Ci, there exists c? G N with the following 
property; for every p G domC there exists q G {0, 1}* for 
which Ci{q) — C{p) and \q\ < \p\ + d. It follows from the 
definition of the composition Ci C2 ■ • • Cn that for 
every p G domC there exists q G {0, 1}* for which (Ci 
C2 • • • CAr)(qr-2r3 . . . r^) = C{p) and \qr2r3 . ..rpfl < 
\p\ + . ■ .rpfl+d. Thus Ci 0C2 • • -^Cn is an optimal 
computer. ■ 
In the same manner as in normal statistical mechanics, we 
can prove Theorem[T2]below for the thermodynamic quantities 
in AIT. In particular, the equations dHJ, and (|9]l correspond 
to the fact that free energy, energy, and entropy are extensive 
parameters in thermodynamics, respectively. 

Theorem 12. Let Ci, C2, . . . , Cat be computers. Then the 
following hold for every T G (0, 1). 

Zci0---0Cn (T) = (T) • • • Zc„ (T), 

Fc,0...0cAT) =FcAT) + --- + FcAT), (7) 

Ec,0-0C.iT) =EcAT) + --- + Ec^iT), (8) 

^Ci0...0C„(T) = ScAT) + --- + Sc^iT). (9) 



For any computer C and any n G N+, the computer 
C ■ ■ ■ q is denoted by C®". 

n 

VI. The proof of the main result 

In order to prove the main result. Theorem |9] we also 
introduce the notion of physically reasonable computer. 

Definition 13 (physically reasonable computer). For any com- 
puter C, we say that C is physically reasonable if there exist 
p,q & domC such that \p\ ^ l^j. ■ 

Then we can prove Theorem [14] below in a similar manner 
to the proof of Theorem 7 of ifTsl . 

Theorem 14. Let C be a physically reasonable computer. 
Then each of the mapping (0, 1) 3 T i-^ Zc{T), the mapping 
(0, 1) 3 T EciT), and the mapping (0, 1) 5 T ^ Sc{T) 
is an increasing real function. On the other hand, the mapping 
(0, 1) 3 T ^ Fc{T) is a decreasing real function. ■ 

In order to prove the main result, it is also convenient 
to use the notion of computable measure machine, which 
was introduced by Downey and Griffiths |6| in 2004 for the 
purpose of characterizing the notion of Schnorr randomness 
of a real in terms of program-size complexity. 

Definition 15 (computable measure machine, Jl]). A computer 
C is called a computable measure machine (/X^pedomC 2~'^' 
(i.e. Zc{l)) is computable. ■ 

For the thermodynamic quantities in AIT, we can prove 
Theorem [T6l below using Theorem [T4l 

Theorem 16. Let C be a physically reasonable, computable 
measure machine. Then, for every T G (0, 1), the following 
conditions are equivalent: 



(i) T is computable. 

(ii) One of Zc{T), Fc(T), Ec{T), and Sc{T) is com- 
putable. 

(iii) All of Zc{T), Fc{T), Ec{T), and Sc{T) are com- 
putable. ■ 

Example 17. The following two computers are examples of 
physically reasonable, computable measure machines, 
(i) Two level system: Let B be a particular computer for which 
dom_B = {1, 01}. Then we see that, for every T > 0, 

ZB(r)-2-i/^ + 2-2/7', 

FB{T) = -Tlog.,ZBiT), 



Eb{T) = 



1 



Zb{T) 

Sb{T) = {Eb{T)-Fb{T))/T. 

(ii) One dimensional harmonic oscillator: Let O be a par- 
ticular computer for which domO = {O'l | I G N}. Then we 
see that, for every T > 0, 

Zo{T) = ^17^, 

Fo(r) = Tiog2 (21/^-1), 

2I/T 

So{T)^{Eo{T)^Fo{T))/T. 

Since Zb{1) = 3/4 and Zo{l) = 1, we see that B and 
O are physically reasonable, computable measure machines. 
Note that Theorems [74] and [76| certainly hold for each of the 
particular physically reasonable computers B and O. ■ 

Based on Theorems [T2l and [T6l the main resuh is proved as 
follows. 

The proof of Theorem |9} We first choose any optimal 
computer V and any physically reasonable, computable mea- 
sure machine C. Then, for each n G N+, we denote the 
computer V (C®") by Vn- By Theorem (TT] we see that 
Vn is optimal for every n G N"*". Furthermore, it is easy to 
see that the infinite sequence Vi , V2 , V3 , . . . of computers is 
recursive. On the other hand, it follows from Theorem [T2l that, 
for every n G and every T G (0, 1), 

ZvST)^Zv{T)Zc{Tr, 
Fv^{T)^Fy{T)+nFc{T), 
EvjT)^Ev{T)+nEc{T), 
SvAT) = Sv{T) + nSc{T). 



(10) 



Let TO and n be arbitrary two positive integers with m > n. 
Then it follows from the equations ( fTOb that 

Zv^{T) ^ ZvAT)Zc{Tr-'\ (11) 

Fv^{T) = Fv„{T) + {m-n)FciT), (12) 

EvAT) = EvAT) + {m-n)Ec{T), (13) 

SvAT) = SvAT) + {m - n)Sc{T) (14) 



for every T G (0, 1). In what follows, using il2\ we show that 
^{Vm)<^^{Vn) = 0. In a similar manner, using (fTTT i. ( fTsT l, and 
(Uli we can show that Z{Vm) D Z[Vn) = £{V^) n £{Vn) = 
S{Vra) r\ S{Vn) = as Well. 

Now, let us assume contrarily that J-{Vm) H J-iVn) 7^ 0. 
Then there exists Tq G (0,1) such that both Fv^{To) and 
Fy^(To) are computable. It follows from (fT2] i that 

Fc{To) = {Fv,ATo) - Fv^To)) ■ 

m — n 

Thus, Fc{Tq) is also computable. Since C is a physically 
reasonable, computable measure machine, it follows from 
Theorem[T6]that Tq is also computable. Therefore, since Vm is 
optimal, it follows from Theorem|5](i) that Fy^ (Tq) is weakly 
Chaitin To-random. However, this contradicts the fact that 
Fv„^{To) is computable. Thus we have T{Vm) r\F{Vn) = 0. 
This completes the proof of Theorem |9] (i). 

Theorem|9](ii) and Theorem|9](iii) follow immediately from 
Theorem [7] and the fact that Vi is optimal for all i G . ■ 
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